A FEW REMARKS ON PERIODIC ORBITS FOR 
PLANAR BILLIARD TABLES 



EUGENE GUTKIN 

Abstract. I announce a solution of the conjecture about the mea- 
sure of periodic points for planar billiard tables. The theorem says 
that if n C M 2 is a compact domain with piecewise C 3 boundary, 
then the set of periodic orbits for the billiard in Q has measure zero. 
Here I outline a proof. A complete version will appear elsewhere. 



1. Introduction 

Let fl C R 2 be a connected, compact domain with a piecewise dif- 
ferentiable boundary. We turn fl into a billiard table by letting a 
dimensionless ball move freely inside, bouncing elastically off of dfl. 
This dynamical system is the billiard in fl. It is a very special case of 
the geodesic flow. The flow lines are the billiard orbits in fl; their prop- 
erties reflect the geometry of the domain. The simplicity of the setting 
makes the planar billiard an ideal "playground": We can ask mean- 
ingful questions about the billiard dynamics essentially from scratch^ 
The billiard in a smooth and convex domain is the "billiard ball prob- 
lem" of G.D. Birkhoff [2]; his study of periodic orbits for the billiard 
ball problem remains a crowning achievement in geometric dynamics. 

The properties of billiard orbits continue to attract our attention, 
suggesting a variety of questions, which seem very basic and turn out 
to be out of reach [1]. Many of the open questions concern periodic 
billiard orbits. These orbits correspond to closed, inscribed polygons 
P C fl that have the following property: At every corner of P the 
two angles between P and fl are equal. Thus, periodic billard orbits 
correspond to harmonic polygons [2] . Using variational considerations, 
Birkhoff discovered that every smooth, convex billiard table had at 
least two infinite families of distinct harmonic polygons, yielding the 
famous Birkhoff periodic orbits. 



Date: February 2, 2008. 

1 This is a free quote of the opinion of G.D. Birkhoff [2]. 
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Most open problems in this subject ask if billiard tables have "suf- 
ficiently many" periodic orbits^ Going in the opposite direction, it is 
natural to ask how big the set of periodic billiard orbits may be. There 
are examples of billiard tables where periodic orbits admit continuous 
deformations. A classical example is the round disc: Rotating har- 
monic polygons, we obtain one-parameter families of periodic orbits of 
the same kind. 

The property of having continuous families of periodic orbits holds 
for an arbitrary ellipsep there are other examples of billiard tables 
with this property. However, all of these examples yield only one- 
parameter periodic families. The question arises if there exists a billiard 
table with a two-parameter periodic family. In such a table we could 
shoot the billiard ball, varying independently the initial position and 
the initial direction, and it would keep returning to the same position 
and direction. The intuition says that no billiard table has the magic 
property. In fact, a well known conjecture states that no billiard table 
has a two-parameter family of periodic orbits [31 H] • 

Periodic billiard orbits are important not only in dynamics; they are 
important in analysis. With a compact euclidean domain Q C M d we 
associate the infinite sequence < Ai < A2 < ■ ■ ■ of eigenvalues of 
a laplacean in Q. There are two classical eigenvalue problems, corre- 
sponding to the dirichlet and the neumann laplaceans. The dirichlet 
eigenfunctions vanish on dfl, while the values of neumann eigenfunc- 
tions are arbitrary on dQ, but their normal derivatives vanish. In what 
follows we will refer to A« as the neumann or dirichlet eigenvalues of Q. 
The motivation for studying the asymptotics of eigenvalues came from 
physics, and the mathematical formulation goes back to D. Hilbert. 
Seminal results about the eigenvalues of euclidean domains were ob- 
tained by H. Weyl around 1911-1915 [H]. 

Let N(i(X) be the number of eigenvalues of Q C M d (either neumann 
or dirichlet) that are less than or equal to A 2 . Weyl's law is the asymp- 
totic formula 

iVn(A) = Cl vo\(n)\ d + o(\ d ). (1) 

The constant C\ is known and depends only on the dimension. Weyl's 
formula has numerous extensions. It is valid, mutatis mutandis, on 
closed riemannian manifolds, riemannian manifolds with boundaries, 
for higher order differential operators, etc [10]. 

2 For instance, it is not known if every convex polygon has a periodic orbit [3]. 
The question is open even for obtuse triangles. 

3 The disc being a special case of the ellipse. 
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The formula equation p]) holds under mild assumptions, but it yields 
only the leading term of the asymptotics of eigenvalues. Note that 
the leading term does not depend at all on the boundary dQ. Weyl 
conjectured that the asymptotic expansion equation continues, and 
that the second term involves vo\(dQ). The precise formulation of his 
conjecture is the equation 

N n (X) = Cl vol{Q)X d ± c 2 vol{dQ)X d - 1 + o(A^ 1 ). (2) 

The constant c 2 is also known and is determined by d; the sign of the 
second term depends on the boundary condition. 

In [7] V. Ivrii proved Weyl's conjecture for compact, C°° domains 
Q C M. d , provided that billiard orbits in fl satisfy an assumption. In 
order to prove equation ([2]), Ivrii had to assume that periodic orbits 
for the billiard in Q spanned a set of measure zero0 

During 1979/80 Ivrii had repeatedly asked the Moscow billiard com- 
munity whether the assumption was redundant. The experts assured 
him that no billiard table had a set of positive measure of periodic 
orbits; however, they could not supply a proof@ 

Ever since the paper [7j appeared, the billiard community at large felt 
that every euclidean billiard table satisfied Ivrii's assumption. Lacking 
a proof, it became a conjecture. In what follows I will refer to it as 
the measure of periodic points conjecture, or simply the periodic points 
conjecture. The conjecture and its variants figure prominently in the 
dynamics literature [121 El HI M > an d i n the analysis literature [TQl E] . 
A few partial results towards the conjecture have been obtained, and I 
will comment on them below. 

In this work I announce a positive solution of the measure of periodic 
points conjecture for planar billiard tables. More precisely, the theorem 
says that if Q C R 2 is a compact, piecewise C 3 domain, then the 
measure of the set of periodic orbits for the billiard in Q is zero. This 
paper is preliminary, and I only outline the proofs. A complete version 
will appear elsewhere. 

From here on, Q is a planar domain, unless explicitly stated other- 
wise. I will comment now on the variants of the conjecture that are in 
the literature. The billiard dynamics in Q has two realisations: As the 
billiard flow, and as the billiard map. The phase space of the billiard 
flow is three-dimensional. Phase points are the pairs (position, veloc- 
ity) where the position can be anywhere in Q. The billiard map is the 

For instance, with respect to the canonical invariant measure. 
5 See http://www.math.toronto.edu/ivrii/Research/preprints/GradTalk3.pdf 
for a colorful account of Ivrii's interactions with participants of Sinai's seminar. 
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poincare map with respect to the cross-section that consists of phase 
points where the position is in dQ. This cross-section is the phase space 
of the billiard map. The liouville measure is invariant for the flow, and 
induces the canonical measure for the map. The flow version and the 
map version of the periodic points conjecture are equivalent. In what 
follows we will work only with the billiard map. 

The phase space for the billiard map is a compact surface with a 
boundary^ that consists of fixed points; we will ignore the boundary, 
and denote by \P = the set of interior points. The set Per(f2) 

of periodic points is a countable union of the sets of n-periodic points, 
Per n (Q), where 2 < n < oo. A seemingly different variant of the conjec- 
ture says that for every n the set Per n (f2) C ^ is nowhere dense. This 
claim is formally weaker than the equation /i(Per n (f2)) = 0; it turns 
out, however, that the two statements are equivalent. See sections El 

There are three kinds of partial results towards the periodic points 
conjecture. First, there are results that establish the claim under addi- 
tional assumptions on the billiard table; e. g., assuming the (piecewise) 
real analyticity of dQ [10] . It is worth pointing out that in this case the 
claim is obvious: If the derivative of a real analytic function vanishes on 
an open set, then the function is constant. Thus, if a real analytic bil- 
liard table Q has an open set of n-periodic orbits, then the nth iterate 
of the billiard map for Q is the identity map, which is absurd. Results 
of the second kind prove the claim for generic (smooth) billiard tables 
[S] • It is obvious that having continuous families of periodic orbits is a 
non-generic property. In fact, for the generic domain Q C M. d the sets 
Per n (f2) are finite [8]. Hence, generically, «(Per(f2)) = 0. 

Since Per(f2) = U nG NPer n (f2), establishing the periodic points con- 
jecture amounts to proving the claim for every n. Partial results of the 
third kind do this for small n. Since 2-periodic points are contained in 
the set of phase points orthogonal to dfl C R d , the smallest period for 
which the claim is not obvious is 3. In [9] M. Rychlik proved that the 
set of 3-periodic points for a planar, convex, infinitely differentiable 
billiard table has empty interior. His proof is based on the follow- 
ing proposition^ For s G dQ let \I/ S C ^ be the set of phase points 
corresponding to shooting the billiard ball from point s in arbitrary 
directions. Rychlik's lemma states that Pers(f2) D ^f s is nowhere dense 
in \l/ s , for any s G dfl. Rychlik's approach is based on symbolic calcula- 
tions involving the length of orbits, and he relied on a software package 



If Q is simply connected, then it is a topological annulus. 
I will refer to it as Rychlik's lemma in what follows. 
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to perform them. In [ 1 1 J L. Stojanov pointed out that the lengths of pe- 
riodic orbits do not change under deformations; this remark disposed 
of the computer part in Rychlik's argument. In [13J Ya.B. Vorobets 
proved Rychlik's lemma using elementary geometry. His proof requires 
only the differentiability of dQ; moreover, it works for euclidean do- 
mains in any dimension. In [15] M.P. Wojtkowski gave another proof 
of Rychlik's lemma; it is based on an analysis of Jacobi fields for the 
billiard. In pQ Y. Baryshnikov and V. Zharnitsky prove that Per 3 (f2) 
is nowhere dense using external differentiable systems (EDS)@ 

2. Overview of the proof 

To simplify the exposition, we restrict the discussion in the technical 
part of the paper to convex billiard tables. We remove the restriction 
in section 0, where we state our main results, and outline the proofs. 
In the discussion that follows we assume that Q is convex. 

Let ip be a n-periodic phase point. Suppose that ip is contained in 
a ball O of n-periodic points. Then the differential DF n is identically 
one on O. In order to study the equation DF^ = 1, we pass to the 
projectivised differential, PDF, that acts on the projectivised tangent 
bundle of See section HI 

Elements of the projectivised tangent bundle have a geometric optics 
interpretation, and the action of PDF is given by the mirror equation. 
See equation (j4]). An orbit i/>o,if)i = F(ip ), . . . ,i/j n -i = F n ~ 1 (ip ), . . . 
yields a sequence of fractional-linear transformations on R U oo. A 
number x G K U oo is interpreted as the signed focusing distance of 
an infitesimal light beam sent along the orbit. Then Xi = PDF 1 oxq is 
the focusing distance for the beam that we obtain after % reflections in 
dQ. The transformation x n = PDF n o x determines the type of our 
periodic point. We have DF^ = ±1, iff x n = x . In this case we say 
that ip is a degenerate periodic point. 

Fractional-linear transformations Xi = Xi(xo) involve products of ma- 
trices. These expressions are awkward to work with. We get around 
this difficulty by working instead with the derivatives dxi/dxo. See 
equation Analysis of these derivatives yields consequences for the 
geometry of harmonic polygons corresponding to degenerate periodic 
points. See Proposition [21 

In particular, we obtain an identity relating the distance between 
consecutive reflection points of the billiard ball and the geometry of 
dQ at these points. See equation (iTTj) . 



8 According to a private communication of Zharnitsky, they are working on 
Per 4 (f2) using the EDS approach. 
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Suppose now that we have an open ball O C ^ of n-periodic points. 
Let So, Si be the endpoints of the directed chord in fl corresponding 
to a phase point if) E O. Note that each point varies independently 
in an open arc, Tj C dQ. Equation (fTTl) yields a functional identity, 
equation (|23|) . relating the radii of curvature of dfl at s , si- 

In section [6] we study this functional identity. Under the assump- 
tion of continuous differentiability of the radius of curvature for dfl, 
we prove that equation f[2"3"l) has no solutions. See Proposition [3] and 
Corollary [TJ 

In section [7J we obtain the main results of the paper. In this section 
we extend the discussion of sections SJ El E] to compact planar domains 
with a piecewise C 3 boundary, disposing of the convexity assumption. 

Theorem [1] states that the set of periodic points for the billiard in Q 
has an empty interior. Periodic points in an open set are degenerate; 
the converse may fail, e. g., the billiard in Q may have isolated degen- 
erate periodic points. Theorem [2] says that degenerate periodic points 
cannot have odd periods. Theorem [3J is about the measure of the set 
of periodic points. It says that /i(Per(f2)) = 0. The proof combines 
Theorem [T] with Theorem H] which is the main result of section [SI 

Thus, Theorem [3J removes the measure zero assumption in Ivrii's 
theorem [7J. By Theorem [3] and Ivrii's result, Weyl's conjecture holds 
for all compact planar domains with C°° boundary. 

In section [8] we show that Per(fi) is nowhere dense iff /i(Per(Q)) = 0. 
We point out that this is a special feature of the billiard dynamics, by 
exhibiting infinitely differentiable, conservative diffeomorphisms of the 
2-torus that do not satisfy this property. 

Periodic billiard orbits are given by a variational principle. This 
fact and Theorem [1] imply Theorem H] about the structure of the set 
of periodic billiard orbits. It says that every Per n (f2) C ^ is a finite 
union of curves and points. 

The billiard map for a compact, convex, planar domain, Q, is an 
area preserving twist map. It is known that the claim /i(Per(fi)) = 
does not extend to such maps [Hj. Hence, it is not surpising that our 
approach is based on the geometry of planar billiards, and that we 
dispose of the convexity assumption. Does the claim /i(Per(f2)) = 
extend to general nonplanar, two-dimensional billiard tables? Section |H] 
addresses this question. 

Let Q be a compact riemannian surface with a (piecewise) smooth 
boundary. The billiard map for Q is well defined, and let /i be the 
canonical invariant measure on its phase space \1/ = Let Per(O) C 

\1/ be the set of periodic points for the billiard in Q. Is /x(Per(fi)) = 0? 
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Suppose that dfl is geodesically convex. Is /i(Per(Q)) = then? In 
section we give negative answers to these questions. Let S 2 be the 
round sphere. We construct infinitely smooth, convex billiard tables 
O C S 2 such that the set Per(Q) has a nonempty interior. Moreover, 
we can make the domains Q in these examples arbitrarily small. See 
Corollary [3j We can also dispose of the convexity assumption. Thus, 
//(Per(fi)) = is not a universal billiard property. 



3. The projectivised tangent bundle 

We begin by establishing the basic notation. Recall that the bil- 
liard table is a compact domain Q C M 2 with a piecewise C 3 bound- 
ary dQ. Each connected component of dQ is positively oriented, and 
parametrised by arclength. Let \I/ = dQ x [0, %] be the phase space of 
the billiard map, F : ^ — > ^f. In the standard coordinatization, phase 
points are the pairs i/j = (s, a) G iff, where s G dfl is the footpoint, and 
< a < tt is the direction angle. The billiard map fixes the boundary 
<9\I/ = dQ x {0, 7r} pointwise. We will work with the interior of the 
phase space, and use the notation \I/ for it. 

In order to simplify the exposition, in sections SI El El which form 
the basis of the paper, we restrict the setting to convex billiard tables. 
In the proof of our main results in section 0, we extend the discussion 
to nonconvex billiard tables. 

Let T\l/ be the tangent bundle. The coordinate vector fields 3/ ds, d/ da 
yield an explicit isomorphism T\l/ = M. 2 x The canonical invariant 
measure satisfies dfi = sina dsda. Let (si,ai) = F(s,a), and let 
DF\/ S)0 a : T( s a ^ — > Tr Slj(Xl )ty be the differential of the billiard ball 
map. The partial derivatives dsi/ds,dsi/da, etc are straightforward 
to compute. See [5], equation 1.1. The invariance of measure /i corre- 
sponds to 

n\ sinai . . 

det(DF\ (s>a) )) = —^. (3) 
sin a 

Let P(T^) be the projectivised tangent bundle. Identifying the pro- 
jective line P(1R 2 ) with the augmented real line R U oo, we obtain an 
isomorphism 

P(T^) = $x(MUoo). 

We will make this isomorphism explicit by coordinatizing P(T^/). By a 
ray we mean an oriented straight line. For a phase point ip G \l/ let R^p C 
R 2 be the corresponding ray. See figured! The correspondence ip i— > 
yields an isomorphism of ^{Q) and the space of rays intersecting 



Here we use the convexity of O. 
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Figure 1. The ray C ffi 2 corresponding to a phase 
point ip G 



Next, we augment each i?^, to an oriented projective line by adding 
the point oo; we will use the same notation for the augmented ray. 
Now we will define a pointwise isomorphism P(T^) ~ Py,. Vectors 
in T^> correspond to infinitesimal deformations of R^. The rays of 
the deformation corresponding to a vector v G intersect R^ at a 
point, / = f(v) G P,/,. The point f(v) does not change under scalings: 
f(tv) = f(v),t 7^ 0. On the other hand, any / G R^ defines an 
infinitesimal deformation of R^, which is unique, up to scaling. The 
deformation corresponding to the point oo moves R^ parallel to itself. 
This establishes an isomorphism between two projective lines: R^ and 
P(T^). 

It will be useful to view elements of P(T^>) as pairs (Rip, f G R^). 
Let ip = (s,a), and let x = x(f) be the signed distance from s to /; 
this identifies R^ with M. U oo. The realisation of P(T\I/) as the space 
of pairs (R^, f G R^p), and the signed distance yield global coordinates 
on P(T^). In this coordinatization, points of the projectivised tangent 
bundle P(T\&) are the triples (s, a, x) where x G M U oo. 

Projectivisation of the tangent bundle turns the differential into 
the projectivised differential PDF : P(TV) -> P(T#). Let (s, a) G * 
and let P(s, a) = (si,ai). In our coordinates on P(T\I>), the map- 
ping PDF has the global form (PDF)(s, a, x) = (si, cti, x\). Since 
both a; and x\ are projective coordinates, and since the restriction 
PDF|( Sja ) : P(T( S)Q )\I/) — > P(T( Sljai )\l/) is a projective transformation, 
the transformation xi = Xi(s,a;x) is fractional-linear. Its coefficients 
are determined by the geometry of dfl at the points s and si. 
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4. Focusing, mirror equation and the projectivised 

differential 

The isomorphism of and P(T^) has an intuitive meaning that 
comes from the geometric optics. In order to explain this intuition, 
we think of the billiard phase points as light rays that are trapped 
inside the room Q with a perfectly reflecting wall, dQ. Infinitesimal 
deformations of a light ray correspond to infinitesimal light beams 
centered about R^. An infinitesimal light beam is determined by its 
position and by its size. In the correspondence between light beams and 
vectors of the tangent space T^, the size of the beam corresponds to 
the norm of the tangent vector; the position of the beam corresponds to 
the line in spanned by the tangent vector. Every infinitesimal light 
beam has a focusing point, / £ U oo, which determines its position. 
This is an isomorphism of the projective lines R^ and P(T^). 

Let R £ \I/ be a light ray, and let R\ £ ^ be the reflected light ray. 
An infinitesimal light beam centered about R and focused at / £ R 
becomes, after reflection in dfl, an infinitesimal light beam centered 
about Ri. Let fi £ R\ be the focusing point of the reflected beam. 
The transformation / i— > f x is given by the projectivised differential 
discussed in section [3j An equation relating / £ R and fi £ Ri is the 
mirror equation of geometric optics. Let k = k(s) be the curvature of 
dfl at the reflection point, and let a be the angle of incidence. 

Let a and b be the signed distances from the focusing points to the 
reflection point. See figure [2] for notation. Then the mirror equation 
says 

- + t = ~ • (4) 

a o sin a 

It follows from elementary euclidean geometry. See [5], Proposition 1.1. 

We will view \l/ x (MUoo) as an extended phase space, and will study 
the orbits of PDF : ^x(MUoo) -> ^x(MUoo). Let {ip,x) £ f x(MU 
oo) be an extended phase point. Let {(ipi,Xi) = (PDFy(ip,x), i £ Z}, 
be the orbit. See figure [3] for notation. 

More precisely, the footpoints are s$; the rays are Rf, the lengths 
are If, the zth focusing point is fi £ Rf its coordinate in Ri is 
we set Hi = li — Xi. The lemma below gives explicit expressions for 
the fractional- linear transformations B i+ i : P(T^ 1 I / ) — > P(T^. +1 \I/) and 
their inverses Br 1 : P(T^) -> P(T^_^). Set ' 



10 



EUGENE GUTKIN 




Figure 2. Focusing of reflected infinitesimal beams: 
The mirror equation. 



Lemma 1. Let dQ be a curve of class C 2 with strictly positive cur- 
vature. Let (ip,x) 6 $ x (R U oo) be arbitrary. Then for i G Z we 
have 



\ 2 

A i+i 



and 



Ui-i 



A, - 



— (h — K+l) 

A? 



Vi ~ (h ~ Ai) 
Proof. By equation (Hj), we have (for any i) 

1 1 1 



(6) 



(7) 



1 

- + 



A 



i+l 



1 1 

Vi-i Xi \ 



Solving for Xi+i and using Xi + yi = k, we obtain the recurrence relation 
equation (jSJ) . The derivation of equation ([7j) goes the same way. ■ 

We will establish conventions relating matrices A = (a, b; c, d) G 
GL(2, R) and fractional- linear transformations by [A] G PGL(2,M) = 
PSL(2, R). Often, we will not notationally distinguish between fractional- 
linear transformations and their representing matrices; if A = (a, b; c, d) G 
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Figure 3. An orbit of the projectivised differential of 
the billiard map. 

GL(2, R), we will use the notation 

. az + b 



and call rational functions of this kind fractional-linear. Note that a 
fractional-linear function is linear iff c = 0. Thus c^0orc = 0isa 
property of [A]. 

Let the setting be as in Lemma [TJ The fractional-linear transforma- 
tion xq i — > Xi is the focusing on ith step. Set Ai — B% - ■ ■ B\. Then the 
focusing on ith step is given by 

Xi = Ai o x . 

Definition 1. Let ipo e and let Ai = (ai, 6^; q, dj), i E 1<, be as 
above. If q = we say taat ine focusing on ith step is linear. J/q ^ 
we say iaat tae focusing on ith step is nonlinear. 

Lemma 2. Tae focusing on the first step is always nonlinear. The 
focusing cannot be linear twice in a row. 

Proof. Since the focusing on 0th step is linear, the former claim is a 
particular case of the latter, which is immediate from equation (jSJ). ■ 



12 



EUGENE GUTKIN 



We will not need explicit formulas for the focusing transformations 
xi = Ai o xq. We will use only their derivatives. 

Lemma 3. Let tp G , and let ^ = P*(^ ), < i, be the orbit. Let 
Xq G R U oo be arbitrary, and let Xi G R U oo be the focusing distance 
on ith step. Then for 1 < k we have 

dxk tt (xi — Aj) 2 . . 

Proof. Differentiating equation (JH]), we obtain 

. , - ^i±l a t . 

l+l 9 U/J/j. 

Solving equation ([8]) for substituting the expression into the equa- 
tion above, and iterating back to i — 0, we obtain the claim. ■ 

5. Periodic points and focusing 

Let n G N. A phase point ip G ^ is n-periodic if F n (ifj) = ip. The 
smallest such n is the minimal period of ■0. A n-periodic point deter- 
mines a harmonic n-gon, P = P(ip,n) C fi. We label the quantities 
pertaining to P by i G Z with the cyclic convention i + n = i, and set 
ipo = ip. If n is not the minimal period, then P is a polygon with a 
multiplicity. See figure H] for an example. 

The differential (DF^) 71 determines the type of periodic point. By 
equation ([3]), (DF^) n G SL(2, R). The n-periodic point ip G ^ is hyper- 
bolic, elliptic, or parabolic if (DF^) n is hyperbolic, elliptic, or parabolic 
respectively] 10 ! By our convention, the matrices ±1 G SL(2,R) are not 
parabolic; if (DF^) n = ±1, then ip is a degenerate n-periodic point. 

Instead of working with differentials, we will use the projectivised 
differentials, or, equivalently, the focusing points. Let f G Po be an 
arbitrary focusing point, and let x G R U oo be the signed focusing 
distance. Then f generates an infinite sequence, /j G Pj, 1 < i, of 
focusing points, and let Xi G R U oo be the focusing distances. For 
< i let Bi = P(DF^) G PSL(2,R) be the projectivised differential 
at ipi. For < i < j set Ajj = P>j-\ • • • P>i- 

Lemma 4. Let ip G ^ be a n-periodic point. Then the following state- 
ments are equivalent: 
1. The point ip is degenerate; 



Note that the type of a n-periodic point depends both on the point and the 
period which need not be minimal. 
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Figure 4. A 6-periodic phase point; the corresponding 
harmonic polygon is the triangle So s i s 2 traced twice. 

2. The identity x n = x holds; 

3. For < i < n — 1 we have dxi +n /dxi = 1. 

Proof. Set A = G PSL(2, R). Then ip is degenerate iff D = 1 iff 

Di = 1 for all i. Thus, properties 1 and 2 are equivalent, and 3 follows 
from 1. It remains to show that 3 implies 1. 

Assume the opposite, i. e., that ip satisfies condition 3, but it is 
not degenerate. Then for < i < n — lwe have Xi +n = Xi + hi for 
some bi ^ 0. Equivalently, every Di = B n+i -\ ■ ■ ■ Bi is unipotent and 
upper-triangular. By periodicity, B n+i = Bi. Therefore 

D\ = B n B n -i ■ ■ ■ Bi = B {B n _i ■ ■ ■ B 1 B ) B X = BqDqBq 1 . 

Thus, D , D\ are unipotent, upper-triangular, and B conjugates them. 
Therefore B is upper-triangular. But, by equation ([6]), B is not upper- 
triangular. ■ 

Proposition 1. Let if) G \1/ be n-periodic. Designate any point of the 
orbit if), F(ip), . . . , F n_1 (-^) as let A , . . . , A n _i be the corresponding 
numbers. Let x G R U oo, and let Xj = Xi(x ),l < i < n — 1, be 
the corresponding focusing distances. Then ip is degenerate iff for any 
choice of ipo and arbitrary xq we have 



n—l n— 1 

\[{x l -\ l ) = ±\[\ l . 

i=0 i=0 



(10) 
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Proof. By Lemma El equation ( |T0|) is equivalent to condition 3 of 
Lemma HI ■ 

Let tp e For < z set ^ = F*^). Let s Q , s 1; . . . e dQ be the 
corresponding sequence of footpoints. Let Aj (resp. U = l(si, s i+ i)) be 
the corresponding numbers (resp. side lengths). 

Proposition 2. Suppose that ip is n-periodic. Then if) is degenerate 
iff n = 2m is even and the following statements hold: 

1. For all i we have 

h = Aj + Aj+i; (11) 

2. We have 

A0A2 • ■ ■ A2m-2 = A1A3 • ■ ■ A2m-1- (12) 

Proof. Let Bi,Aj ti be as in Lemma HI and set = A^ j0 . Then for 
< i the rational function Xi = A$ o xq has one of the expressions 

Xi = Pi + qi(x - r.;) -1 ; x t = ftx - Pi (13) 

where Pi,qi,r{ G K with 7^ 0. Thus, Xj has the former (resp. latter) 
form iff the focusing on zth step is nonlinear (resp. linear). 

The rational function F(xq) = YYi=o( x i ~ ^ s a product of n 
fractional-linear functions x^xq) — Aj. Suppose first that ip is degener- 
ate. Then, by Lemma HI F = const. 

Let / C {0, 1, . . . , n — 1} (resp. J C {0, 1, . . . , n — 1}) be the set 
of indices such that x^Xq) — Aj is linear (resp. nonlinear). Then the 
asymptotics of F(x ) as x — > 00 satisfy 

F(xq) = const Xq 7 '~' j ' + 0(xq / '~' J ' _1 ) 

with const 7^ 0. Since, by Lemma [21 |J| < n/2, our assumption implies 
that |/| = I J| = n/2, hence n = 2m. Since 6 /, by Lemma [21 
J = {0, 2, ... , 2m — 2}, J = {1, 3, ... , 2m — 1}. Thus, the focusing is 
linear on every even step and nonlinear on every odd step. 
By equation (jSJ) 

+ + (x{ — Aj) — {fi — Aj — Aj + i) 

Calculating from equation <HM the expression x i+2 — A i+2 in terms of 
Xi — Aj, we see that the function x 2 (x ) is linear iff l\ — Ai — A 2 = 0. 

By periodicity, we can do the preceding analysis starting from any 
point of the orbit. Starting from i — 1, we obtain Zj — Aj — Aj + i = 0. 
Thus the degeneracy implies the identities equation f TTTT) . 
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Conversely, suppose that the identities equation ( fTTj) hold. Then 
by elementary calculations, for < k < m — 1, we have the focusing 
equations 

-l A 2fc-l 



%2k+l — ^2fc+l 



X 2 

A 2k-\ 

X 2 X 2 
A 2k A 2k-2 



•AI 



a^2fc - A 



2/v 



X 2 X 2 X 2 

A 2fc A 2fc-2 A 2 



X 2 X 2 X 2 

, A 2fc-l A 2fc-3 A l 

Multiplying out these equations, we obtain 

2m-l 



x - x y 

X - Aq). 



n^-A,) = (-irA^---A 



2m- 1- 



i=0 



Compairing this with Lemma HI we conclude that equation (fTTl) implies 
the degenerate focusing iff the identity equation ffT2l) holds. ■ 

Remark 1. The argument above shows that the sign in equation ( fTOl) 
is determined by the pairity of n/2. Namely, case i) holds iff n = 
mod 4; case ii) holds iff n = 2 mod 4. 

6. Degenerate periodic points and a functional relation 

In this section we will study the relation implied by equation ffTT]) . 
We will view phase points ip G ^ as directed chords; they correspond 
to pairs (so, si). See figure El 




Figure 5. A billiard chord and its attributes. 



Let k(s),p(s) denote the curvature and the radius of curvature. Let 
l(s , Si) be the chord length. Differentiating with respect to s and s\, 
and using elementary geometry, we obtain: 

dl(s Q , Si) = — cos a ds + cos acidsi, (15) 



16 

and 
and 



dar 



da i 



sin «o 
I 



sin ao 
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- k(s ) ) ds + 



smtJi 
/ 



dsi, 



I 



ds + 



sin oc\ 



+ k(si) ds\. 



(16) 



(17) 



In the proposition below by a curve we mean a smooth immersion 
/ : / — > IR 2 , where J C K is an open interval. We identify a curve 
with its image V C M 2 . By the smoothness class of V we will mean the 
smoothness of the mapping / : / — > F. 

Proposition 3. Let T Q , Ti C K 2 be C 3 curves and let c be a constant. 
Suppose that for all Si G Tj we have 

p(s ) sin a + p(si) sin a\ = (1 + c)l(s , si). (18) 

Then c = and both T , F% are arcs of a circle. 

Proof. It is classical that the identity equation fflBl with c = holds 
for any pair of arcs of a circle. 

Differentiating the identity equation ffTB"]) . and using relations ffT5l) . ffT6l) . ffTTj) . 
we obtain 

cosai 



cosa . , 
P (so) + — ; — P(sq) 



I 



I 



-ccot «o, 



and 



p\si) 



cosai cos«o 

-Pi s i) H ; — P( s o) = ccot ai. 



(19) 



(20) 



Z rv ' I 

Differentiating the identity equation ( 1191) with respect to S\, using the 
relations equations (|T6l) . ( 1T71) . and solving for //(si), we obtain the 
expression 



P'(si) 



cos(ao — ai) . . cos2ai . . 

-p(s ) + p{si) + tan«! 



/ cosai 



/ cosai 



sin ao 



(21) 

Subtracting equation f[2"Tj) from equation (T2"U1) . we obtain a linear 
relation between p(s ), p(si). After simplifications, we have 



sin «o tan ai sin a>i tan ai 
j P{So) + ^ P(si) 

A further simplification yields 

sin a p(s ) + sinaip(si 



tana 



cot «i + 



tan ai 
sin 2 a 



tanai 



tana! — c 



cot Cl\ + 



tana 



sin ao 



(22) 
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From equations ( ITBl) . ( |22l) . we have 
1 + c = 1 - c 



cot 2 tti + 



sin 2 ao 



implying c = 0. 

It remains to show that the identity smaop(so) + sinaip(si) = 
1(sq, si) implies that r , Ti are arcs of the same circle. Subtracting 
equation (120]) from equation fTl9l) . we obtain the identity 

p'(si) — p'(so) = c [ c °t «o + c °t ai] . 
Since c = 0, by our preceding calculations, this implies p = const. ■ 

Note that Proposition [3] yields a characterization of euclidean circles. 
Namely, a round circle is singled out by an identity satisfied by the 
distance between points of any pair of its arcs, no matter how small 
they are. The following statement is immediate from Proposition [31 

Corollary 1. Let T ,Ti C M 2 be C 3 curves. For Si G r« let be the 

respective angles, and let /(so,Si) be the distance. The relation 

p(so) sin ao + p(si) sin a.\ = 2 /(s , si) (23) 
cannot hold identically. 

7. Main results 

We will now apply the preceding material to study periodic points for 
the billiard in a planar, compact domain, with a piecewise C 3 bound- 
ary. Denote by Ell(O), Hyp(fi), Par(fi), Dgt(fi) C Per(fi) C * the sets 
of elliptic, hyperbolic, parabolic and degenerate periodic points respec- 
tively. The subscript indicates the period; for instance, EU n (f2) is the 
set of elliptic n-periodic points. 

Theorem 1. Let Q C M 2 be a compact domain with a piecewise C 3 
boundary. Then the set of periodic points for the billiard in Q has an 
empty interior. 

Proof. Assume first that Q is convex, and that dQ is C 3 . Suppose that 
the claim is false, and let O C \1/ be an open set of periodic points. Let 
F : $ — > ^ be the billiard map. By taking a smaller O, if need be, 
we obtain n G N such that F\q = Id. Thus, all ^ G O are degenerate 
n-periodic points. 

Let so(ip), si (■?/>) be the endpoints of the chord of Q defined by ip. As 
ip varies in O, the points So(^), Si(ip) run through open arcs To^i C 
dQ. By equation (fill) , the pairs s , Si satisfy the identity equation (123^1 . 
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By Corollary [TJ this is impossible. This establishes the claim for convex 

a 

We observe that convexity of Q has not been used in the analysis of 
the projectivised differential that led to equation (fTTj) . It was conve- 
nient to assume convexity in order to identify phase points with rays 
intersecting Q. A local version of this identification does not require 
convexity. In some of the analytic arguments that yielded equation (fTTj) 
we used the positivity of A = p(s)sina/2. These arguments remain 
valid as long as p(s) does not change sign. The change of sign can 
occur only at points of dQ where its curvature vanishes, becomes infi- 
nite, or jumps. The two latter possibilities can happen only at isolated 
points of dQ. By going to a smaller open set in if need be, we can 
ignore these points. The same argument holds if the curvature vanishes 
at isolated points. Vanishing of the curvature on an interval means that 
dfl contains a straight arc. If the set of footpoints of ip G O contains 
any curved arcs, then we get rid of flat arcs via the reflection trick [Tj. 
This trick changes dfl; the curve that replaces dfl has an open set of 
periodic billiard orbits which do not pass through flat arcs. Thus, we 
can apply the preceding argument. If the billiard orbits generated by 
O encounter only flat arcs in dfl, then we have a polygonal billiard 
table with an open set of periodic orbits. This is impossible [JJ. 

We summarise the preceding argument as follows. Assuming an open 
set of periodic billiard orbits, we either come to a contradiction right 
away, or arrive to a situation considered in Corollary [TJ But this is a 
contradiction as well. ■ 

Several publications have proved the nonexistence of an open set of 
3-periodic billiard orbits [TJ El dH [131 EES] • Recall that periodic billiard 
points that belong to an open set of those are necessarily degenerate. 
The converse fails: A billiard table may have isolated degenerate peri- 
odic orbits. 

Theorem 2. Let Q C M 2 be a compact domain with a piecewise C 3 
boundary. Then for any odd n there are no degenerate n-periodic points 
in Q. 

Proof. For convex Q this is a part of Proposition [21 The argument in 
the proof of Theorem [TJ that shows how to remove the assumption of 
convexity in that statement, works here just the same. ■ 

A lebesgue-type measure on a manifold is a measure that is given by 
a local different iable density. The canonical invariant measure for the 
billiard in Q C R 2 is lebesgue-type. 



PERIODIC BILLIARD ORBITS 



19 



Theorem 3. Let Q C K 2 be a compact domain with a piecewise C 3 
boundary. Let /i be a lebesgue-type measure on ^ . Then fi(Per(Q)) = 0. 

Proof. Let n G N be arbitrary. By Theorem H] of section the set 
Per n (Q) C ^ of n-periodic points is a finite union of sub manifolds of 
smaller dimension. ■ 



8. Appendix 1: Periodic points of the billiard map and 
critical locus of the perimeter function 

The set of n-periodic points of a conservative surface diffeomorphism, 
F : S — > S, may have a complicated structure. In particular, it may be 
nowhere dense and have positive measure. We will outline an example. 

Let T 2 = S 1 x S 1 be the standard torus, and let dfi = dx dy be the 
lebesgue measure. We consider selfmappings of the form F(x, y) = (x+ 
f(y),y), G(x, y) = (x,y + g{x)). Then F : T 2 - T 2 , G : T 2 - T 2 ) are 
conservative diffeomorphisms of the same smoothness as the functions 
/ : S 1 -f S 1 , g : S 1 -f S 1 ). The composition H = G o F : T 2 -> T 2 
satisfies H(x,y) = (x + f(y),y + g(x + f(y))- Let Zf,Z g c S* 1 be 
the zero sets of /, g, and let fix(-) denote the set of fixed points of a 
diffeomorphism. Then &x(H) — Zf x Z s . 

For any kantor set K C S 1 there exists a C°° function f : S 1 —> S 1 
such that .fT = Zy. Combining this remark with the preceding analysis, 
we obtain the following statement. Let K', K" C S 1 be arbitrary cantor 
sets. Then there exists a conservative, C°° diffeomorphim H : T 2 — > T 2 
such that fix(^) = K' x K" . 

This yields examples of conservative surface diffeomorphisms with 
fractal sets of periodic points. However, this cannot happen for the 
billiard, in view of a relation between its set of n-periodic points and 
the critical locus of the perimeter function on (dQ) n . We will now 
establish this relation. 

Let (1 C R 2 be a compact, strictly convex^! domain with a C k bound- 
ary. Rescaling the metric if need be, we assume without loss of gener- 
ality that \dQ\ = 1, and identify dQ n with the torus T n = x n (S 1 ) = 
{(s ,...,s n _i)}. Set 

p(s , Sn-i) = l(s Q , Si) H h /(s n _i, s ). (24) 

Note that p(s , . . . , s n _i) is the perimeter of the inscribed "polygon" 
PI So, . . . , s„_i) with corners So, . . . , s n -i- (By parentheses, we indi- 
cate that consecutive corners Sj,Sj + i need not be distinct. When this 



We make this assumption for simplicity of exposition. 
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is the case, we will say that P(sq, . . . , s n -i) is a degenerate polygon. 
Otherwise, P(s , . . . , s n _i) is a nondegenerate polygon.) 

By a C k curve in \1/ we will mean the range of a C fc immersion 
/:[0,l]->*. 

Theorem 4. Lei C M 2 &e a compact domain with a piecewise C 3 
boundary. Then for any n G N i/ie set Per n (Q) C ^ is a finite union 
of C 2 curves and points. 

Proof. Denote by q n : T n — > the projection that sends (s , • • • , Sn-i) 
to (s , Si) G We will deduce the statement from a sequence of 
claims. 

1. Let crit„(f2) C T n be the critical locus of the function given 
by equation ff24|) . Then for (s , • • • , Sn-i) G crit n (f2) the "polygon" 

s , ... , s n _i) is either a harmonic n-gon or s = • • ■ = s n _i. 

A string of indices < i < j < n—1 is degenerate if — ■ ■ ■ — Sj. Let 
< i < j < n— 1 be a maximal degenerate string in (sq, • • • , s n _i) G T™. 
If < i or j < n — 1, then, by equation ffTBT) . (s , . . . , s n _i) ^ crit n (f2). 
This proves claim 1. 

We identify the set of completely degenerate n-tuples (s , . . . , s n -i) 
with dQ, and denote by t) n (Q) the set of harmonic ra-gons. Thus 
crit n (fi) = f)„(fi) U a disjoint union. 

2. The restriction of q n : T n — >• ^ to f) n (0) yields a surjective, one-to- 
one mapping g n : t) n (Q) -> Per n (Q). Let (s , • • • , s n _ x ) G crit n (0). 

The criticality condition equation fTl5|) means that (si, s 2 ) = F(sq, Si), 
etc. Claim 2 is immediate from this observation. 

3. The restriction q n : f) n (0) — > Per n (f2) is a C 2 diffeomorphism. 

By claim 2 and compactness of f) n (^), the map q n : f) n (fi) — > 
Per n (f2) is a homeomorphism. Let ip = (so,S\) G \& be arbitrary. 
The point (s , • • • , Sn-i) G T n is obtained by applying F % to ■0. Hence 
the smoothness class of the mapping r n : ^ — >• T n given by r n (so, Si) = 
(so, . . • , s n _i) is that of F; the latter is 1 less than the smoothness of 
dQ. By our assumption, it is C 2 . By claim 1, the restriction of r n to 
Per n (fi) is the inverse of q n . The claim follows. 

The set f) n (0) C T n is (essentially) the critical locus of the function 
p n given by equation By a separate argument, its critical locus is a 
finite union of C 2 submanifolds. By claim 3, these are also sub manifolds 
of hence their dimension is at most 2. But, by Theorem [XJ, their 
dimension is less than 2, i. e., they are points and curves. ■ 

The following proposition slightly extends Theorem HI 
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Corollary 2. Let Q C IR 2 be a compact domain with a piecewise C 3 
boundary. Let nGN. 

Then \Ell n (Q) U Hyp n (Q)\ < oo; the set Par n (Q) UDgt n (Q) is a finite 
union of C 2 curves and points. 

Proof. Immediate from Theorem H] and the observation that every point 
in Ell n (fi) U Hyp ri (f2) is isolated. ■ 

9. Appendix 2: Spherical billiard tables with open sets of 

periodic orbits 

We will outline a construction of compact, C°° billiard tables Q C S 2 
that have open sets of periodic orbits. Let a, ft <Z S 2 be two meridians 
forming a bigon, B = B(p7t/q), with angle pvr/gj^ let e be the equator. 
Let a' G a,b' G (5 (resp. a" G a, b" G (3) be arbitrary points that 
are below (resp. above) the equator. Let w', w" C S 2 be convex arcs 
joining a and (3 tangentially, whose tangency points are a', b' and a", b" 
respectively. Let Q C S 2 be the convex domain formed by a, f3,w',w". 
See figure [6] for notation. 

The concepts and the notation that we have developed for the planar 
billiard pertain to the present situation as well; we will use them from 
now on. Let s G dfl be the point where the equator crosses a. Let 
V'o — ( s o? vr/2) G ^/ be the phase point formed by e at the crossing. 

Proposition 4. There is an open set Oc$ containing ipo such that 
O \ {ipo} consists of periodic points with rotation number p/q. 

Proof. Let E, W be the leftmost, rightmost points of e, and let N, S 
be the north, south poles respectively. Let A, p be the left, right half- 
geodesics forming the geodesic in S 2 passing through N, E, S,W . A 
geodesic 7 in a neighborhood of e is determined by the points x = 
x (j) — 7 H A, y = 2/(7) = 7 R p. Let j(x, y) C S 2 be the corresponding 
geodesic. 

For < e let 67 e be the set of geodesies 7(2;, y) such that x, y are e- 
close to W respectively. If e is sufficiently small, then any 7(2;, G 
G e intersects a between a' and a" defining a phase point ip(x,y) G ^. 

We will now compare the billiard orbits in Q and the bigon B = 
B(jm/q). Let ^ be the phase space for the billiard in B. Using the 
notation above, let ip(x,y) G ^ be the phase point determined by the 
geodesic 7(2;, y) when it intersects a. We recall the device of unfolding 
a billiard orbit defined for any spherical polygon [6]. In our case it 
associates with any phase point if) G ^ a geodesic, j(if>), in S 2 and a 



Here p, q S N are relatively prime integers. 
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Figure 6. A convex billiard table on the round sphere 
with an open set of periodic orbits. 

sequence Bi of isometric images of B arranged along j(if)), so that any 
two consecutive images are related by a geodesic reflection. We have 
7('0(x, y)) = ^(x,y). Using the unfolding, we show that every ip(x,y) 
is a periodic phase point [6]; the sequence of domains Bi returns to the 
"initial position" after 2q consecutive reflections, producing a cyclic 
string of bigons B i: < % < 2q — 1, with B 2q = -BoO 

Let ji(x,y) C j(x,y) be the segment of ^(x^y) inside Bi. Note 
that the unfolding procedures for the billiard in fl and the billiard in 
B coincide as long as ■ji(x,y) intersects the walls of Bi between a', a" 
on one side and between b',b" on the other. The deviation of 7(^,7/) 
from the equator is a continuous function of x, y. Therefore for any 
a', a", b', b" there exists < e such that every 7 e G £ will stay within 
the requred bounds. 

Let 0(e) C \& (resp. 0(e) C ^) be the set of phase points corre- 
sponding to j(x, y) G G £ . Since each point x, y varies independently of 



With the exception of ipo which is always 2-periodic [5] . 
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the other in an open interval, we conclude that 0(e) (resp. 0(e)) is an 
open neighborhood of ip® (resp. ipo). The unfoldings of orbits of phase 
points ip G 0(e) and ip G 0(e) coincide. The claim now follows from 
the corresponding claim for B(pii/q) [5J. ■ 

For integers 1 < p < q denote by e(p/q) C e a segment of length 
p7r/q. The following assertion is immediate from the preceding proof. 

Corollary 3. Let 1 < p < q be relatively prime. There exist convex 
C°° domains Q G S 2 that contain e(p/q), approximating it arbitrarily 
closely, and such that the following holds: i) The billiard map for Q has 
an open set O of q-periodic points (and q is the minimal period) with 
rotation number p/q; ii) The corresponding billiard curves have length 
2pn. 

Remark 2. It is worth pointing out that the phenomenon observed 
in the examples of Corollary [3] holds for nonconvex domains as well. 
Indeed, let Q be as in Corollary [3J and let Q C Q' C S 2 be arbitrary 
domain satisfying dVl'Da = dVlDa, dQ! 'n/3 = <9f2fl/3. Then the billiard 
in Q' has an open set of g-periodic points. 

Indeed, it is immediate from the preceding discussion that the orbits 
of phase points ip G O encounter only the common part of dQ and dQ'. 
Thus, these orbits are "unaware" that they "live" in the bigger billiard 
table Q'. 
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